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OBJECTIVE BAYES, CONDITIONAL INFERENCE AND THE SIGNED ROOT 

LIKELIHOOD RATIO STATISTIC 

THOMAS J. DICICCIO, TODD A. KUFFNER, AND G. ALASTAIR YOUNG 


Abstract. Bayesian properties of the signed root likelihood ratio statistic are analysed. Conditions for 
hrst-order probability matching are derived by examination of the Bayesian posterior and frequentist means 
of this statistic. Second-order matching conditions are shown to arise from matching of the Bayesian poste¬ 
rior and frequentist variances of a mean-adjusted version of the signed root statistic. Conditions for condi¬ 
tional probability matching in ancillary statistic models are derived and discussed. 


1. Introduction 

In problems concerning inference on a scalar interest parameter in the presence of a nuisance parame¬ 
ter, the signed root likelihood ratio statistic is a fundamental object of statistical methodology. The focus 
of this paper is an analysis of the signed root statistic from an objective Bayes perspective, where the 
issue of identification of prior distributions which display the property of probability matching is central. 
Under probability matching, quantiles of the Bayesian posterior distribution have the property of being 
confidence limits in the conventional, frequentist sense. 

Considering inference based on a sample of size n, we establish a number of results. If we choose 
the prior distribution in a Bayesian analysis so that the frequentist and Bayesian posterior means of 
the signed root statistic match to Op{n~^), then the prior achieves first-order probability matching: the 
Bayesian 1 — a posterior quantile has frequentist coverage 1 — a + It is observed that such 

matching of frequentist and Bayesian posterior means occurs when the prior satisfies the conditions 
noted by Peers (1965), who extended to the nuisance parameter case work of Welch & Peers (1963). We 
further obtain a simple condition, related to the Bayesian posterior and frequentist variances of a mean- 
adjusted version of the signed root statistic, under which the prior is second-order probability matching, 
so that the frequentist coverage of the Bayesian 1 — a quantile is 1 — a + 0(n“^/^). This condition is 
shown to be equivalent to that established by Mukerjee & Dey (1993) and Mukerjee & Ghosh (1997) 
by an analytically more elaborate shrinkage argument. Our analysis therefore provides a transparent and 
intuitive interpretation, in terms of the distributional properties of the signed root statistic, for existing 
conditions for probability matching priors. 

In particular statistical problems, specifically those involving inference on canonical parameters in 
multi-parameter exponential family models and in models admitting ancillary statistics, the appropriate 
frequentist inference is a conditional one, so that the relevant objective Bayesian notion is that of a condi¬ 
tional probability matching prior. We further provide an analysis of the conditional frequentist behaviour 
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of Bayesian posterior quantiles in ancillary statistic models, as was carried out for the exponential fam¬ 
ily context by DiCiccio & Young (2010). Their approach involves matching of higher-order conditional 
frequentist and Bayesian asymptotics, yielding simple conditions for probability matching. In the ancil¬ 
lary statistic context, this approach does not, however, yield any general, easily interpretable conditions, 
unlike the methodologies applied here. By considering the distributional properties of the signed root 
statistic, we note first that if the unconditional first-order probability matching condition of Peers (1965), 
which we refer to as the Welch-Peers condition, is satisfied, then the prior automatically enjoys the prop¬ 
erty of first-order conditional probability matching. We then establish our key result, which identifies a 
simple condition involving the Bayesian posterior and conditional frequentist means of the signed root 
statistic, under which the conditions for second-order probability matching in an unconditional sense 
ensure also second-order conditional probability matching. 

2. Notation 

Consider a random vector Y = (Yi,, Yn) having continuous probability distribution that depends 
on an unknown (g-|-1)-dimensional parameter 6* = (6*^,... ,6*'^+^), and denote the log likelihood function 
for 0 based on Y by L(0). Suppose that 0 is partitioned in the form 0 = (i/), 0), where '0 is a scalar 
interest parameter and 0 is a g-dimensional nuisance parameter. Let 0 = (i^, 0) be the overall maximum 
likelihood estimator of 0, and let 0(ip) = 0(t/))} be the constrained maximum likelihood estimator of 

0 for given ip. The log profile likelihood function for ip is M('0) = L{0{^jJ)}. 

In the asymptotic calculations that follow, standard conventions for denoting arrays and summation are 
used. For these conventions, it is understood that indices z, j, /c,... range over 2,..., q+1, and that indices 
r,s,t,... range over 1,..., g -f 1. Summation over the relevant range is implied for any index appearing 
in an expression both as a subscript and as a superscript. Differentiation of the functions L{0) and M{;ip) 
is indicated by subscripts, so Lr{0) = dL{0)/d0^, Lrs{0) = d‘^L{0)/d0^d0^, Mi{'tp) = dM{'ip)/d'p, 
Mii('0) = d'^M[pj)/, etc. In this notation, Lr(0) = 0 (r = 1,..., g-|- 1) and Mi('0) = 0. Evaluation 
of the derivatives of L(0) at 0 and the derivatives of M{ip) at ip is indicated by placing a circumflex above 
the appropriate quantity; for example, = Lr{0) = 0, L^s = Lrs{0), Mi = Mi{'ip), Mu = Mii{'ip), 
etc. Let Ar = E{Lr{0)} = 0, = E{Lr.s{0)}, Kst = E{Lrst{(^)}, etc., and define = Lr{0) — Xr = 

Lr{0), Irs = Lrs{0) — Xrs, Irst = Lrst{0) “ A^st, ctc. The constants Xrs, Xrst, Gtc. are assumed to be 
of order 0{n); the variables U, Irs, Irst, etc. have expectation 0, and they are assumed to be of order 
The joint cumulants of Ir, Irs, etc. are assumed to be of order 0{n). These assumptions are 
usually satisfied in situations involving independent observations. 

In subsequent calculations, it is useful to extend the A-notation: let Xr,s = E{Lr{0)Ls{0)}, Xrs,t = 
E{Lrsi0)Lt{0)}, Xr,s,t = E{Lr{0)Ls{0)Lt{0)}, etc. Identities involving the A’s can be derived by re¬ 
peated differentiation of the identity J exp{L{0)}dy = 1; in particular, A^^ + A^.s = 0, Xrst + Xrs,t + Xrt,s + 
Xst,r + Xr^s,t = 0. Differentiation of the definition Xrs = / Lr<j(6') exp{L(0)}d|/yields Xrs/t = Xrst + Xrs,t, 
where Xrs/t = dXrs/d0K 

Let (A'"®), (L'’^) and (L'’^) be the (g+1) x (g+1) matrix inverses of (Xrs), (Lrs) and (I/rs)> respectively. 
Define = X^^X^^/X^\ f’’" = = A'’" - and Note that A^^ 

and are all of order and and are all of order Op{n~^). Lurthermore, 
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1/A^^ = AriAsir^'® is of order 0{n) and 1/L^^ = LriLgif^^ is of order Op{n). Note that = A^^ and 
= 0; thus, the entries of (g + 1) x (g + 1) matrices and are all 0 except for the lower 
right-hand submatrices and which are the inverses of (Ajj) and (Lij), respectively. 

3. Signed root statistic and probability matching 

The likelihood ratio statistic W{^jJ) = 2{M(^) — M(^)} is useful for testing the null hypothesis 
Hq : Ip = ipQ against the two-sided alternative Ha '■ pJ ipo or for constructing two-sided confidence 
intervals. However, for a scalar interest parameter, it is natural to conduct one-sided tests, where the 
alternative is either Ha '■ pJ > i>o or Ha '■ ip < ipo, or io construct one-sided, upper or lower, confidence 
limits. One-sided inferences can be achieved by considering the signed square root of the likelihood ratio 
statistic Rpip) = sgn{ip — ip){W{ip)Y^‘^, which has the standard normal distribution, iV(0,1), to error of 
order 0{n~^R), so that the iV(0,1) approximation produces one-sided confidence limits having coverage 
error of that order. The order of error in the iV(0,1) approximation to the distribution of R{ip) can be 
reduced (DiCiccio & Stern, 1994a) to 0(rz,“^) by correcting for the mean of R{ip)- 

The signed root Rpip) behaves (DiCiccio & Stern, 1994b) identically from a Bayesian perspective: the 
posterior distribution of R{ip) is standard normal to error of order and the order of error in 

the iV(0,1) approximation to the posterior distribution of R{ip) can be reduced to 0(rz,“^) by correcting 
for the posterior mean. These order statements are asserted conditionally given the data, so it is appro¬ 
priate to use O(-) rather than Op(-) to describe the errors associated with the iV(0,1) approximation. 
To distinguish frequentist and Bayesian inference, let /Xi? = fipid) denote the frequentist mean of R{ip) 
and let /ig = irsiX) denote the posterior mean. Applying the iV(0,1) approximation to the posterior 
distribution of R{ip) — /xb yields approximate posterior percentage points for ip having posterior prob¬ 
ability error of order 0{n~^). If the prior distribution is chosen so that /xb = /x^ + Op{n~^), then the 
posterior distribution of R{ip) — /xb coincides with the frequentist one to error of order 0{n~^). Thus, 
for such a prior distribution, the upper 1 — a posterior percentage point is necessarily an approximate 
upper 1 — a frequentist confidence limit having coverage error of order 0{n~^). As noted. Peers (1965) 
derived a condition that the prior distribution must satisfy in order for it to have this first-order probability 
matching property, although not by the method considered here of matching the Bayesian posterior and 
frequentist means of the signed root statistic. 

DiCiccio & Stern (1994a) showed that /xb is 

fiF = -f 'qXrs/tX^'^X''* + Xrs/tX"'^X^^X*^ + 0(n“^/^), 

where r] = (—A^^)“^/^. A general expression for /x^ is derived in the Appendix. 

To compare and /xb, note that 

= -ir^A^iA’^iA'-^ - lr]^XrstX^^y^X^^ + + Op{n-^) 

in the frequentist sense; hence, Op{-) is used for the error term in place of 0{-). Thus, the condition 
I^B = fi-F + Op{n~^) is met when the prior satisfies 
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A Standard result of matrix algebra gives ^ so it follows that 



r 


rl \ st 


-Xrs/tX^^X 


dr] 

W 


-WXst/rX^^X 


tl. 


eonsequently, the eondition on the prior ean be written as 


( 1 ) 


( 91 og 7 r( 0 ) ^d{r]X^^) 

^ de^ ’ 

r 


whieh is what we have termed the Weleh-Peers eondition. 

In many oases, Weleh-Peers priors are not unique; for example, under parameter orthogonality, the 
prior is (Tibshirani, 1989) essentially the Jeffreys prior on the interest parameter, multiplied by an ar¬ 
bitrary funotion of the nuisanoe parameter. As a means to ohoose among the Weleh-Peers priors, it is 
natural to attempt to determine those that are seoond-order probability matohing, i.e., those for whieh the 
peroentage points are one-sided eonfidenee limits having eoverage error of order This problem 

has been well-studied, and Mukerjee & Dey (1993) and Mukerjee & Ghosh (1997) have given a differen¬ 
tial equation, auxiliarly to the Weleh-Peers eondition, that the prior must satisfy for it to be seeond-order 
probability matohing: see Datta & Mukerjee (2004, Theorem 2.4.1) for a summary. The objeotive here 
is to demonstrate that the auxiliary eondition ean be developed by eonsidering a mean-adjusted version 
of the signed root statistio. 

DiCiooio & Stern (1993) showed that the posterior expeetation of {i?('0)}^ is 1 + as + 0(n“^/^), 
where 


as = 

_ 1 / ^ru ^sw ^tv 

6 ^ 






and n, = n,( 0 ), n,, = n,,( 0 ), with n,( 0 ) = 7r,(0)/7r(0), n„( 0 ) = 7r„(0)/7r(0), 7r,(0) = dTi{e)/de^, 
T^rs{(^) = d‘^7r{9)/d9^d9^. It follows that the posterior varianee of Ri'ijj) — ]iB is 


cr| = 1 -f as - /i| -f 0{n ^/^). 

When the prior satisfies eondition (1), from a frequentist perspeetive, sinee ]ib is of order Op{n~^R) and 
= /iF + Op{n~^), where fip is of order 0{n~^R), it follows that ]i% = ]ip + Op{n~^R), where ]ip is 
of order 0(n“^); hence, the posterior variance satisfies 

cr| = 1 -f Of - /i| + Op(n“^/^). 

DiCiccio & Stern (1994b) showed that the frequentist expectation of {R{'ip)}‘^ is 1 -f of + 0(n“^/^), 
where 


Of — (A'’^A*“ — F^®F*“)(AArstM — Arst/„ -f Art/su) 

" A,,iA„,/^ + Xrs/tXu./^) 

- A„tA„,/^ + A„/iA„,/^) + 0(n-3/2). 
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It is shown in the appendix that E^hb) = + 0{n and so it follows as a partieular case of the 

results of DiCiccio & Stern (1994a) that the frequentist variance of -R('0) — is 

(Jj? = 1 + dp ‘2TjjJ,F/r^ — I^F “f 0(^n ), 

where i^p/r = dfip/dd^. 

From both Bayesian and frequentist perspectives, the third- and higher-order cumulants of R{^p) — 
are (DiCiccio & Stern, 1994a) of order 0(n“^/^) or smaller. Thus, the marginal distribution of — 

and the posterior distribution of {R{4’) ~ I^b}/(^b are both standard normal to error of order 
0{n~^R) \ moreover, if tt{6) is a prior density such that = cr|,-|-Op(n“^/^), then 7r(6*) is a second-order 
probability matching prior: a formal proof follows the same argument as that used in our main result in 
Section 4 below. The condition under which 7 r( 6 ') will be a second-order probability matching prior is 
therefore that 

dB = dp + 2rjiiF/ry^ + 

Since 

^ _ l(\rs\tu ^,rs^,tu\\ 1 / \ ru \ st \ titt; ^ ,ru^ ,st ^ ,vw\ \ \ 

OjB 41^^ P P j'^rstu 41^^ A A U V V J 

_(A--zy-)n,, + Op(n-3/2), 

this condition can be expressed as 

dF + 2r^liF/ry^ = 

_ 1 (A™a-a*’^ - + (A’^^A'^ - - (A^* - i/^^)n,,. 

By assuming that the prior density 71 ( 6 ^) satisfies the first-order probability-matching condition (1), the 
condition for second-order probability matching reduces to 

^rsTT ^rs\tu\ TT _ (^rs^,tu \ \ru^st\vw\ \ 

T llrs ^ '^rst^^u ^ \ ^ j^rst/u A T A ^rst^uv/w 

(\ru^,sw^tv I ^ ,ru^ ,sw ^tv\ \ \ \ (^ru\st^,vw \ l^ru^st^vw\\ \ 

(^A V T -\- V V T ) ^rst^uv/w A U ~\- -^T T T ) ^rs/t^uv/w 

I _ru \sw.tv\ \ 

A y ArpgjiA-iii^iyj^ 

which may be written more succinctly as 

^ ^ QQr +2^ QQrQQs 

r r,s 

This condition is that given by Mukerjee & Dey (1993), who considered a scalar nuisance parameter, 
and by Mukerjee & Ghosh (1997), who considered a vector nuisance parameter. 

4. Conditional inference 

The main motivation for our analysis is to investigate the conditional frequentist properties of approx¬ 
imate confidence limits obtained from Welch-Peers priors. Suppose that A is an ancillary statistic such 
that {9, A) is sufficient. To undertake calculations with respect to the conditional distribution of Y given 
A, or equivalently, with respect to the conditional distribution of {9, A) given A, it is useful to consider 
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the versions of the A’s obtained by applying their definitions to the eonditional distribution. The resulting 
eonditional quantities are distinguished notationally from the uneonditional ones by the inelusion of the 
accent symbol Since the conditional log likelihood function L(9) differs from the unconditional log 
likelihood function L{9) by a constant, i.e., a quantity that depends on A but not on 9, it follows that 
Lj. = Lr, Lrs = Lrs, ctc. Thus, = EY\A{Lr), Ks = -E'y|yi(-^rs)> ctc. Notc that Xr = 0. The quantities 
Ks, Kst, etc. are random variables depending on A, and they are assumed to be of order Op{n). The 
variables lr = Lr, Irs = Lrs — Ks, etc. all have zero conditional expectation, and hence they have zero 
unconditional expectation, and they are assumed to be of order Op(n^/^). The joint conditional cumu- 
lants of lr, lrs, etc. depend on A, and they are assumed to be of order 0{n) given A and of order Op{n) 
unconditionally. The identities that hold for the A’s immediately carry over to the A’s. 

In the calculations that follow, it is necessary to take into account the differences between the A’s and 
the A’s. To describe the difference between A^s and Xrs, first note that EA{Xrs) = EA{EY\AiLrs)} = 
EY{Lrs) = Xrs', morcovcr, 

VarA(A,.J = WaiA{EY\A{Lrs)} = Vary(Lr,,) - EA{^SXY\A{Lrs)} 

= vary(/rs) - EA{yaxY\A{lTs)] = 0{n) - EA{Op{n)] = 0{n). 

With respect to the distribution of A, Xrs has mean Xrs and variance of order 0(n); thus, A^^ — A^s, 
Kst — Xrst, etc. have expectation 0 and variance of order 0{n). It is assumed that these quantities are of 
order Op{n^^'^) and have joint cumulants of order 0(n) with respect to the distribution of A. In particular, 

Xrs Xrs L)p(^Tl ^ j, Xrst Xrst A L)p{Ti ^ j, CtC. 

Assume that differentiation of the identity Xrs = Xrs + Oplp}^"^) yields Xrsjt = 'Xrsjt + Oplp}!"^). We 
note that, as a rule, differentiation of an asymptotic relation will preserve the asymptotic order, but that 
care is necessary; see Barndorff-Nielsen & Cox (1994, Exercise 5.4). The difference between Xrsjt and 
Xrsjt indicated here actually constitutes an additional assumption of our calculations, though validity is 
immediate in particular cases, such as the example considered in Section 5. Then, 

ArSjt ^rsjt ^rst ^rsjt ^rst T Op(n ^ ) Xrs^t T Op(jn ^ ). 

By working with the conditional density of Y given A in place of the marginal density of Y, it follows 
that is conditionally N{0, 1) to error of order and that the error in the N{0, 1) approx¬ 

imation to the conditional distribution of R{^jJ) can be reduced to order 0{n~^) by adjusting for the 
conditional mean of Denote the conditional mean by [ip-, then R{'ip) — ftp has conditionally the 

A^(0,1) distribution to error of order 

The calculations of DiCiccio & Stem (1994a) can be applied to the conditional distribution of R{^jJ) to 
show that 


Af = -lriXrsty^°X^^ - lri^Xrsty^°X^^°X^^ + + |? 7 ^Ar^/tW^A^^A‘^ + 0{n ^Z^), 


where fj = (—A^^)“^/^. Furthermore, the preceding comparisons of the A’s and the corresponding A’s 
shows that /Ip = jip + Op{n~^), and hence, fip = Af + Op{n~^), provided the condition (1) holds. It 
follows that Welch-Peers priors satisfying (1) produce approximate confidence limits having conditional 
coverage error of order This result is implicit in DiCiccio & Martin (1993), who compare the 
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Bayesian percentage points under an objective prior with the approximate, conditional confidence limits 
derived from Bamdorff-Nielsen’s r* statistic (Barndorff-Nielsen, 1986); see also Nicolau (1993). 

Since /is = /Jf + Op{n~^), it follows that i?y|^(yUF) = flp + 0{n~^). In resolving conditional 
properties of second-order probability matching priors, the crucial issue turns out to be to examine cir¬ 
cumstances under which EyiAifJ-B) = Af + holds. Since = 0, an argument analogous to 

that given in the Appendix for f{9) defined in (A.l) shows that EyiAifJ-B) = E!y\A{fiO)} + 0(n“^/^), 
so the crucial criterion reduces to Ey\A{f{d)} = Af + which holds provided 


(3) 


,aiog7r(0) = 1 


d9^ 


A’'! = fjXrs/ty^X"^ + Ifi^Xrs/ty^X^^X^^ + 


Suppose that f is a first-order probability-matching prior, so that (1) holds, that satisfies further the 
condition £'y|A(/^F) = + Let ap denote the conditional frequentist variance of i?('0) — i^b- 

From arguments similar to the ones given previously that showed /jf = /Jf + Op{n~^), it follows that 
cr‘^p = (j'jr + Op(n“^/^). To be specific, recall that 


cr| = 1 -f Of + 2r]ij,p/rX'^^ — Ef + 0{n ^/^), 


where of + 2rifip/rX'^^ — fip is of order 0{n ^) and can be expressed, to error of order 0(?7, ^/^), as a 
function of the A’s. By applying identical calculations, which we note require the condition Ey^Aif^B) = 
(If + to the conditional distribution, it follows that 


^"p — 1 -f hp -\- 2?7/iF/rA^^ ~ Ef T 0{n 


where of + 2fi(lp/rX'^^ — flp is of order Op{n ^) and can be expressed, to error of order Op{n ^/^), as 
the identical function as can its unconditional version, with each A being replaced by its corresponding 
A. Since by assumption each A differs from its corresponding A by Op(n“^/^), it follows that ap = 
ap + Op{n~^^‘^). Hence, the condition that ensures f{9) is a second-order probability-matching prior 
in the marginal frequentist sense also ensures that it is a second-order probability-matching prior in the 
conditional frequentist sense. 

Thus, if f{9) is a second-order probability-matching prior in the marginal frequentist sense, then it is 
also a second-order probability-matching prior in the conditional frequentist sense provided Ey\A{9‘B) = 
/iF + i.e., provided (3) holds. This is satisfied if 


( 4 ) + \f}^Ks/My^°y^. 

We summarize our conclusions in the following theorem. 


Theorem 1. Suppose that the prior f is such that (4) holds, so that Ey\A{dB) = Af + 0{n ^/^). If the 
prior also satisfies (1) and (2), so that ap = af + then the Bayesian quantile is second-order 

conditional probability matching. 


Proof: Given Y, let Y) be the posterior 1 — a quantile for the interest parameter, so that 

pr{'0 < Y)\Y} = 1 — a. Also, given Y and provided the log likelihood is unimodal, R{f) is 

a monotonic decreasing function of ip. Therefore, pr{i?('0) > R{ipi)\Y} = 1 — a, where R{ip) is the 
signed root statistic constructed from Y. That is. 
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pr 


R{'ip) - /xs ^ - /is I 


(Tb 


C^B 


r ^ = 1 - a. 


Since the posterior distribution of {Rii/j) — /is}/crs is A^(0,1) to error of order then by the 

delta method from Seetion 2.7 of Hall (1992), pr[iV(0,1) > {R{^jJl) — fis}/ o'b] = 1 — a + so 

that — /is}/(TB = Za + 0(n~^^^), in terms of the iV(0, 1) quantile Za defined by = a. 

By the monotonieity of i?('0) given V, the event "0 < V'z is equivalent to the event R(ip) > R{'ipi)- 
Thus, from a eonditional frequentist perspeetive, given an aneillary statistie A = a,we have, again using 
the delta method, and by the frequentist distributional result for the mean-adjusted signed root statistie. 


pr('0 <'il^i\A = a) 


prj 

IRW- 

fJ'B 

> 

1 

to 

|A = a| 


1 as 



(Tb 

prl 

(RW- 

f^B 

+ 



\ 

1 ap 



cb j 

prj 

r RW - 

g^B 

> 

Za + Op{n~^ 

V2)|^ = a| +0(n-3/2) 


1 ap 




J 

prj 

1—1 

o' 

> z 



= 1 — a -I- 


5. Discussion 

Conditions under whieh a Bayesian prior on a sealar interest parameter in the presenee of a nuisanee 
parameter aehieves probability matehing have been shown in this paper to have direet interpretation in 
terms of the frequentist and Bayesian distributional properties of the signed root likelihood ratio statistie. 
A prior which is first-order probability matehing in a marginal sense is necessarily first-order eonditional 
probability matehing. A prior whieh is seeond-order probability matehing in the marginal sense yields 
seeond-order eonditional probability matehing provided a simple eondition (4), whieh may be interpreted 
as a eonditional version of the marginal Weleh-Peers condition (1), holds. Second-order uneonditional 
matehing is seen to eorrespond to matehing of the frequentist and Bayesian varianees of a speeifie mean- 
adjusted version of the signed root statistie, where the adjustment is by the Bayesian mean, under a prior 
whieh ensures first-order matehing. Similarly, eonditional probability matehing is typieally aehieved only 
under a very partieular prior speeifieation. These eonelusions indieate, to our mind, that seeond-order 
probability matehing is too stringent a eriterion to be useful in praetiee. 

For illustration, eonsider a loeation-seale model, with Yi,..., an independent sample from a density 
of the form /(//; /x, a) = a~^g{a~^{y — /x)}. The appropriate eonditioning aneillary is the eonfiguration 
statistie A = {Ai, ..., A„) = {{Yi — jj)/ a,, (Y„ — /x)/(j}, and the log-likelihood is of the form 


n 

L(/x, cr) = —n log a + h 

i=l 


jl — jl 



1 


(J 
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with /i(-) = log 5 f(-). Then, since the conditional distribution of {(/t — /i)/cr, a/a}, given A = a = 
{ai,, an), does not depend on (/j, a), simple calculations show = CjcB, = 

D jcB, where B, C, D are non-zero functions of a. The corresponding unconditional quantities are of the 
form = Bg/a'^, = CglcB, X^a = Dg/a'^, for constants Bg, Cg and Dg depending only on g and n. 

In the notation of Section 4, it is then immediate that differentiation of the relation A^s = A^^ + 
yields the assumed relation Xrs/t = Xrs/t + Op{TAB'j in this case. 

Consider the case where the location parameter /i is the interest parameter, with a as nuisance param¬ 
eter. Then the right hand side of the matching condition (4) is easily seen after some algebra to reduce to 
aC/E, where E = BD — C^. The left hand side of (4) is, after some manipulation, 

a'^Ddlog'K a‘^C dlogTi 
“E E 

so that the matching condition is satisfied if and only if 

5 log TT 5 log TT 1 

dg. 'da a' 

which gives 7r(/i, a) oc 1/a. This prior is easily seen to satisfy (1) and (2), and is therefore second-order 
conditional probability matching. In fact, the prior is (Lawless, 1982, Appendix G) exact conditional 
probability matching, and is (Datta & Mukerjee, 2004, Section 2.5.2) the unique second-order uncondi¬ 
tional matching prior. 

Analogous calculations yield the same conclusion in the case where the scale parameter a is the 
interest parameter, with g nuisance: the unique solution to the conditional matching condition (4) is 
7 r(/j, a) oc 1/a, which is again exact conditional probability matching. Now, however, second-order mar¬ 
ginal matching priors are not necessarily unique. In the Cauchy location-scale model, for example, any 
prior of the form 7r{g, a) oc d{g)/a, for any smooth positive function d(-), is second-order unconditional 
matching: see Datta & Mukerjee (2004, Section 2.5.2). 

In general, therefore, second-order conditional probability matching is only achieved by the exact con¬ 
ditional probability matching prior ^{g, a) oc 1/a. We have noted, however, that first-order conditional 
probability matching is achieved by any first-order unconditional probability matching prior in the class 
satisfying the Welch-Peers condition (1). 


Appendix 

Derivation of/is. Repeated differentiation of the definition M('0) = L{0('0)} yields Mi (i/i) = O,Mii('0) 
Miii(^) = LrstiA^L^^L^^/{L^^)^- Taylor expansion about-0 yields 

IL(j/;) = -Mii(V> --0)^ -f + Op{n-^). 

Consequently, 

Wi'iP) = {Z{'iP)Y - + Op{n-Y, 

where Z(V') = -^p) = and M = (-Mn)^/^. Since Mm = , 

the signed root statistic R{'ip) has the expansion 

Ri'iP) = Z{iP) - + Opin-^). 
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The Laplace approximation to the marginal posterior density function of xjj given by Tierney & Kadane 
(1986) can be written as 

7r^|Y(V') = cexp{B{ip) + 

for values of the argument ^|; such that ip = ip + where c is a normalizing constant, 7r(0) = 

TT{ip,(p) is the prior density, and 


BW = -I log 
Differentiation oi B{ip) yields 


-Li^{ip,p^)\ \ I 

- i 1 7 r(V;, 0 ) J 


D _ 1 tj2 j frlfr 

ni — ■^12 IJrst^ ^ 


, l*4f jrlfslftl A2^1og7r(0) 
“T o-W ij ij — 11 


86'^ 


' rl 


e=e 


which is of order 0(1). By Taylor expansion about ip, 

7rv.|y('0) = {27r)~^^^H exp{-l^^('0 - ipf}{l - Bi{'^ - V') - + 0{n~^)}, 

so the marginal posterior density of Z{ip) has the expansion 

'^zmY{z) = (27r)"^/^e“^"/^{l - H~^Biz - + 0{n~^)], 


from which it follows that 

/is = -H-^B, - + 0{n-^) 


_ 1 Tj f frljrs 1 Zt 3 f frlfslftl , fj 

— — ^rst^ ^ ^rst^ 1~^ 1~^ \ 


d\og'K{9) 


6 


89^ 


U^ + 0{n-^). 


e=e 


A more careful analysis that takes higher-order terms into account, i.e., that includes terms of order 
0{n~^), shows that the error term in the preceding formula is actually 0 (n“^ 0 ) 


Higher-order analysis of the Bayesian mean. Since the focus here is the frequentist mean of /i^, it is 
appropriate to describe error terms in expansions by using the Op{-) notation instead of the 0{-) notation. 
To simplify subsequent calculations, /is is conveniently written in the form 9-b = f{9) + Op{n 3/2), 
where 

(Al) f{9) = 

and H = (—L^3)-i/2 Recall that f{9) is Op{n~^/‘^). If the prior density 7r(0) satisfies the Welch- 
Peers condition then /is = /is + Op{n~^), and hence, E{^b) = /^f + 0{n~^). We establish here that 

E(/is) = ^^F + 0 (n“ 3 / 2 ). 

Note that, by Taylor expansion about 9, 

f{9) = f{9) + U9){9^ - 9n + Op{n-^/^) = f{9) - fr{9)X^% + Op{n-^/^), 

since 9'' — 9^^ = + Op{n~^). Now, fr{9) is Op{n~^/‘^), and it is a function of the L’s. Let fr{(^) 

be the quantity obtained when each of the L’s in fr{9) is replaced by its corresponding A, so fr{d) is 
a nonrandom quantity depending on 9. Then fr{9) = f^{9) + Op{n~^), and hence E{fr{9)X'^^ls} = 
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II 


E{f^{9)y^ls + Op{n~^/'^)} = It follows that-E(/iB) = E{f{9)} + 0{n~^/'^), so it is required 

to show that E{f{9)} = 

We have L'’® = A'"® — X'^X^’^Uu + Op{n~‘^), so that 

H = ^ ^ Op(n-^/2), - ^rj^X^^X^H^s + Opin-^/^). 

Consider first the final term of f{9); the other terms can be handled similarly. It follows from the 
preceding equations that 


Hence, 


^aiog7r(0) 1 


J\og7i{9) ^,1 I^3aiog7r(0),41, 
^ d9r ^ ~ d9r ^ ^ ^ 


- 7 ] 


51og7r(0) 

W 


A^*A*'/,4 + Op(n-3/2). 


\ 89^ j 


I 89^ V ^ 

VXrs/tX^^y^ + XfJ^Xrs/tX^^y^X^^ + 0(n-3/2), 


by virtue of the Welch-Peers condition (1). The other terms in /(6*) have 


E{-XHLrstL^^U^) = -ir/A,,4A'-iA^* + 0(n-3/2), 

E{-\H^LrstL^^U^L^^) = -|r^3A,,4A'-U^U'i + 0(n-3/2), 

and combining these expressions yields the desired result, namely E{f(9)} = fip + 0(n“^/^). 
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